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(54) Noise reduction method utilizing color information, apparatus, and program for digital image 
processing 



(57) A digital image processing method for reducing 
the noise of a color digital Image having pixel values, 
includes the steps of: identifying one or more color re- 
gions in color space; identifying a pixel of interest in the 
color digital image; calculating a coior weighting factor 
for the pixel of interest, the color weighting factor being 



a near continuous function of the one or more color re- 
gions; using the color weighting factor and the values of 
pixels sampled from a local neighborhood of pixels 
about the pixel of interest to calculate a noise reduced 
pixel value; replacing the original value of the pixel of 
interest with the noise reduced pixel value; and repeat- 
ing the steps for other pixels in the digital image. 



202 



CM 
< 

CM 
CO 



203 



203 




FIG. 7 



CL 
111 



Printed by JOLWe, 76001 PARIS (FR) 



1 



EP 1 174 824 A2 



2 



Description 

[0001 ] The present invention relates to a method, ap- 
paratus, and computer program for processing color 
digital [mages to reduce noise. 
[0002] The image structure of color digital images can 
be thought of as made up of two components: a signal 
component and a noise component. In many digital Im- 
aging applications it is desirable to amplify the signal 
component while in the same instance reduce the noise 
component The difficulty of achieving both these goals 
for a color digital image processing application simulta- 
neously lies in the inherent differentiability of the signal 
and noise components. No technology at present 
achieves a perfect decomposition of image data into 
these two components. Thus current image processing 
noise reduction algorithms result in either some loss of 
the signal component or not enough noise component 
removal or both. It has been recognized in the image 
photographic field that the color of different real world 
objects can be used to advantage with regard to signal 
and noise processing. 

[0003] in US. Patent # 5,682,443 Gough and Mac- 
Donatd disclose a method of processing color digital im- 
ages for the purposes of spatial sharpness characteris- 
tic enhancement. In this disclosure, a method of un- 
sharp masking is discussed which separates an original 
color digital image into two parts based on the spatial 
frequency co ntent of the original colo r d igital image. The 
difference between the original pixel values and a low 
spatial frequency component of the original pixef values 
forms a fringe component, or high spatial frequency 
component. Gough and MacDonald teach a method of 
modifying the fringe component based on the color of 
either the low spatial frequency component or the orig- 
inal pixel values. Their method also discloses that the 
preferred method of implementing this feature uses a 
continuous mathematical function of color. The method 
disclosed by Gough and MacDonald takes advantage 
of color as an image characteristic for enhancing the 
spatial detail. However, the unsharp masking procedure 
employed by Gough and MacDonald Is designed to vary 
the amplification of the signal component and is not ef- 
fective for the purposes of reducing of the noise compo- 
nent. 

[0004] In US. Patent # 4,689,666 Hatanaka discloses 
a m ethod of usi ng the color ch aracterlstics of a color d ig- 
ital Image for the purposes of reducing the noise com- 
ponent of the color digital image. In the method dis- 
closed, Hatanaka describes a process of extracting 
color data for each picture element of the image, dis- 
criminating regions of the color digital image exhibiting 
a specific color on the basis of the extracted color data, 
and subjecting the image signal to spatial image 
processing for eiimination of noise under different 
processing conditions for regions exhibiting the specific 
color and the remaining regions not exhibiting the spe- 
cific color. Thus the method taught by Hatanaka has as 



a fundamental step the segmentation, or discrimination, 
of each pixel as belonging to the specific color or not 
belonging to the specific color. The step color discrimi- 
nation can lead to unevenness in the processed images 
s due to the on/off nature of the color identification proc- 
ess. 

[0005] There is thus a need for a noise reduction al- 
gorithm which uses the color characteristic of a color 
digital image to advantage the process of noise reduc- 
ed tion in a smooth and even manner without producing 
switching artifacts typical of segmentation based deci- 
sion based methods. 

[0006] The need is met according to the present in- 
vention by providing a digital image processing method 

is for reducing the noise of a color digital image having 
pixef values, that includes the steps of: identifying one 
or more color regions in color space; identifying a pixel 
of Interest in the color digital Image; calculating a color 
weighting factor for the pixel of interest, the color weight- 

20 ing factor being a near continuous function of the one 
or more color regions; using the color weighting factor 
and the values of pixels sampled from a local neighbor- 
hood of pixels about the pixel of interest to calculate a 
noise reduced pixel value; replacing the original value 

25 of the pixel of interest with the noise reduced pixel value; 
and repeating the steps for other pixels in the color dig- 
ital image. 

[0007] The present invention has the advantage that 
noise reduction is applied to preferentially treat different 
30 regions of color space in a continuous fashion so that 
spatial artifacts are avoided, It has the further advantage 
that different color regions, such as skin, sky t and grass 
can be treated differently to obtain a pleasing image. 

35 Figure 1 is a pictorial diagram showing a color digital 
image and a visualization of the corresponding 
color-based noise reduction processing produced 
with the application of the present invention; 

40 Figure 2 is a block diagram showing an image 
processing system suitable for practicing the 
present invention; r 

Figure 3 is a block diagram showing image process- 
es ing according to one embodiment of the present in- 
vention; 

Figure 4 is a block diagram showing image process- 
ing according to a preferred embodiment the 
so present invention; 

Figure 5 Is a block diagram showing the noise re- 
duction module according to the preferred embod- 
iment of the present invention; 

55 

Figure 6 is a diagram showing different color re- 
gions as practiced by the present invention; 
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Figure 7 is a block diagram showing a radial pattern 
local neighborhood of pixels used by to the present 
invention; 

Figure 8 is a block diagram showing a 5 by 5 pixel 
rectangular local neighborhood of pixels module 
used by to the present invention; and 

Figure 9 Is a block diagram showing a 3 by 3 pixel 
rectangular local neighborhood of pixels module 
used by to the present invention. 

[00D8] A color digital image is comprised of a two or 
more digital image channels. Each digital image chan- 
nel is comprised of a two-dimensional array of pixels. 
Each pixel value relates to the amount of light received 
by the imaging capture device corresponding to the ge- 
ometrical domain of the pixel. For color imaging appli- 
cations a color digital image will typically consist of red, 
green, and blue digital image channels, Other configu- 
rations are also practiced, e.g. cyan, magenta, and yel- 
low digital image channels. For monochrome applica- 
tions, the digital image consists of one digital image 
channel. Motion imaging applications can bethought of 
as a time sequence of colo r digital images. Those ski lied 
in the art will recognize that the present Invention can 
be applied to, but is not limited to, a color digital image 
for any of the above mentioned applications. 
[0009] Although the present invention describes a 
digital image channel as a two dimensional array of pixel 
values arranged by rows and columns, those skilled En 
the art will recognize that the present invention can be 
applied to mosaic (non rectilinear) arrays with equal ef- 
fect. Those skilled in the art will also recognize that al- 
though the present Invention describes replacing origi- 
nal pixel values with tone brightness adjusted pixel val- 
ues, it is also trivial to form a new color digital image with 
the noise cleaned pixel values and retain the original pix- 
el values, 

[0010] Figure 1 shows a pictorial diagram of one of 
the important aspects of the present invention. An ex- 
ample source color digital image is shown as input to a 
first processing module which produces a color differ- 
ence value for each pixel. A second processing module 
produces a color weighting mask This color weighting 
mask is used by a third processing module to produce 
a noise reduced color digital image. 

General Description of a Digital Imaging System 
Application 

[0011] The present invention may be implemented In 
computer hardware. Referring to Figure 2, the following 
description relates to a digital imaging system which in- 
cludes an image capture device 1 0, a digital image proc- 
essor20, an image output device 30, and a general con- 
trol computer 40. Thesystem may include a monitorde- 
vice 50 such as a computer console or paper printer. 



The system may also include an input device controi for 
an operator such as a keyboard and or mouse pointer. 
Still further, as used herein, the present invention may 
be implemented as a computer program and may be 

5 stored In a computer memory device 70 I.e. a computer 
readable storage medium, which may comprise, for ex- 
ample: magnetic storage media such as a magnetic disk 
{such as a floppy disk) or magnetic tape; optical storage 
media such as an optical disc, optical tape, or machine 

10 readable bar code; solid state electronic storage devic- 
es such as random access memory (RAM), or read only 
memory (ROM); or any other physical device or medium 
employed to store a computer program. Before describ- 
ing the present invention, it facilitates understanding to 
note that the present invention is preferably utilized on 
any well-known computer system, such as a personal 
computer. 

[0012] Multiple capture devices 1 0 areshown illustrat- 
ing that the present invention may be used for color dig- 

20 ital images derived from a variety of imaging devices. 
For example, Figure 2 may represent a digital photofin- 
ishlng system where the image capture device 10 is a 
conventionaf photographic film camera for capturing a 
scene on color negative or slide film and a fifm scanner 

25 device f o r scan ning the deve loped image on the film an d 
producing a color digital image. The digital Image proc- 
essor 20 provides the means for processing the color 
digital images to produce pleasing looking images on 
the intended output device or media. Multiple image out- 

30 put devices 30 are shown illustrating that the present 
invention may be used in conjunction with a variety of 
output devices which may include a digital photographic 
printer and soft copy display. The digital image proces- 
sor 20 processes the color digital image to adjust the 

35 overall brightness and/or tone scale of the color digital 
image in a manner such that a pleasing looking image 
is produced by a image output device 30, The interaction 
between these processing steps is explained in more 
detail below, 

40 

General Description of a Digital Image Processor 20 

[0013] The digital image processor 20 shown in Fig- 
ure 2 is illustrated in more detail in Figure 3. The general 

4$ form of the digital image processor 20 employed by the 
present invention is a cascaded chain of image process- 
ing modufes. The source color digital image is received 
by the digital Image processor 20 which produces on 
output a processed color digital image. Each image 

so processing module contained within the digital image 
processor 20 receives a color digital image, modifies the 
color digital image or derives some information from the 
color digital image, and produces passes its output color 
digital image to the next image processing module. Two 

55 enhancement transform modules 22 are shown as the 
f i rst and last I mage processin g modules with! n th e digital . 
image processor 20 to illustrate that the present inven- 
tion can be used in conjunction with other image 
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processing modules. Examples of enhancement trans- 
form modules 22 might Include, but are not limited to, 
modules designed to sharpen spatial detail, enhance 
color, enhance contrast, and enhance the tone scale of 
a color digital image. It should be understood within the 
context of the discussion of the present invention that 
the term input color digital image and output color digital 
image refers to the color digital image received and pro- 
duced by an image processing module respectively. 

Preferred Digital Image Processor 20 

[0014] The cascaded chain of image processing mod- 
ules employed by the present invention is shown in Fig- 
ure 4, The source coior digital image produced by the 
capture device 10 is received by a color transform mod- 
ule 24. The output color digital image produced by the 
color transform module 24 is received by the logarithm 
transform module 26. The output color digital image pro- 
duced by the logarithm transform module 26 is received 
by the noise reduction module 1 00, The outputcolor dig- 
ital Image produced by the noise reduction module 1 00 
constitutes the noise reduced color digital image pro- 
duced by the digital image processor 20 shown in Figure 
2. 

Details of the Color Transform Module 24 

[00 15] A characteristic of the colo r d igital image pro- 
duced by a capture device 10 which can impact the ef- 
fectiveness of the present invention is the color space 
metric associated with the capture devices which pro- 
duce color digital images. Typically the capture device 
10 incorporates three color spectral filters which deter- 
mine the relative amounts of colored light received by 
the photosensitive transducer elements. Depending on 
the characteristics of the spectral filters, better results 
may be achieved with the present invention if a color 
transform is applied to the coior digital Image preceding 
the application of the noise reduction module 100. Al- 
though the application of a color transform is not re- 
quired to practice the present invention, optimal results 
may be achieved if a color transform is applied based 
on The spectral characteristics of the input and/or output 
devices, 

[0016] The color transform method employed by the 
present invention is a 3 by 4 matrix transformation. This 
transformation generates new color pixel values as lin- 
ear combinations of the input color pixel values. The in- 
put color digital image consists of a red, green, and blue 
digital image channels. Each digital image channel con- 
tains the same number of pixels. Let Ry, G,j, and B,j refer 
to the pixel values corresponding to the red, green, and 
blue digital image channels located at the i th row and j th 
column. Let R'y, G' f j, and B',j referto the transformed pix- 
el values of the output color digital Image. The 3 by 4 
matrix transformation relating the input and output pixel 
values is as follows: 



R lj + Tl2 G lj + tl3 B IJ + ^0 0) 



5 G 'lj = T 21 R ij + X 22 G ij + T 23 B ij + T 20 

B 'ij = %l R IJ + T 32 G lj + ^33 B ij + T 30 

10 where the terms are the coefficients of the 3 by 4 
matrix transformation. These twelve numbers are spe- 
cific to the spectral characteristics of the capture device 
10 and the intended image output device 30 shown in 
Figure 2, Different methods exist for applying a color 
transform to a color digital image, e.g. a 3-dimensional 
LUT may achieve even better results albeit at greater 
computational cost. If the t 10i t 20 and t 30 values are set 
to zero a simplified 3 by 3 matrix equation results. For 
the purposes of the present invention, a 3 by 3 matrix 
transform, 3 by 4 matrix transform, and a 3- dimensional 
LUT will all be considered examples of a color transform. 

Details of the Logarithm Transform Processor 26 

[0017] A characteristic of the color digital image pro- 
duced by a capture device 10 which can impact the ef- 
fectiveness of the present invention is the code value 
domain associated with capture device which produce 
color digital images. Typically the capture device 1 0 in- 
corporates a photosensitive transducer element which 
converts the imaged light into an analog electrical sig- 
nal. An analog-to-digital converter device is then used 
to transform the analog electrical signal into a set of dig- 
ital code values. These digital code values constitute the 
numerical pixel values of the output color digital image 
produced by the capture device 1 0. The code value do- 
main characteristic of a capture device 1 0 describes the 
mathematical relationship between the output digital 
code values and the input intensity of received light. 
[0018] Many photosensitive transducer elements 
have a linear characteristic response, i.e. the electrical 
analog signal produced is linearly proportional to the in- 
tensity of received light, Many analog-to-digital convert- 
er devices have a linear characteristic response, i.e. the 
digital code values produced are linearly proportional to 
the intensity of received electrical analog signal. If a lin- 
ear transducer element and a linear analog-to-dlgitai 
converter are employed by a capture device the result- 
in g outp ut code values wi II h ave a linear relatio nsh ip with 
the intensity of the received light. Thus the color digital 
images produced by capture devices which exhibit this 
linear relationship have numerical pixel values which 
have a linear relationship with the original intensity of 
light. Such color digital images will be termed to have a 
linear code value domain property. 
[001 9] The present invention may be applied to color 
digital images which have a linear code value domain 
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property. However, better results are obtained with the 
present invention if the input color digital image has a 
logarithmic code value domain property, i.e. the numer- 
ical pixel values have a logarithmic relationship with the 
original Intensity of light. The logarithm transform mod- 
ule 26 shown j n Figure 4 is employed to change the code 
value domain property of the color digital image input to 
the brightness tone scale module 100. The logarithm 
transform module 26 generates a look-up-table (LUT) 
transform populated with numerical values which have 
a logarithmic relationship to the LUT indices. Let py refer 
to the pixel values corresponding to a digital image 
channel located at the i* h row and j th column. Let p'y refer 
to the transformed pixel values of the output color digital 
image produced with the LUT transform. The LUT trans- 
form relating the input and output pixel values is as fol- 
lows: 

p'^LUTlPijj (2) 



duced color digital image with a less dtscernable noise 
than source color digital image. Let the source color dig- 
ital image refer to color digital image produced by the 
previous image processing module in the digital image 
s processor 20. 

[0022] Referring to Figure 5 t the source color digital 
image channels of the source color digital image, typi- 
cally three channels corresponding to red, green, and 
blue pixel Information, are received by the luminance- 
10 chrominance module 110. This module produces three 
digital image channels; a luminance digital image chan- 
nel and two chrominance digital image channels. The 
chrominance digital image channels are received by the 
cotor weighting factor generator 120 which produces a 
15 color weighting mask . The noise filter module 130 re- 
ceives the color weighting mask and the source color 
digital image and produces a noise reduced color digital 
image. 

20 Details of the Luminance-Chrominance Module 110 
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where the Q notation refers to the LUT indexing opera- 
tion, i.e. the output pixel value p'y is given by the numer- 
ical value stored in the LUT at the index given by the 
input pixel value pg. The values stored in the LUT may 
be computed by the following mathematical relation- 
ship: 

LUT[kJ = L Q + L 1 log(k+k 0 ) (3) 

where the numerical constants L 0 and Lj are used to 
determine the scale the output pixel values an d the con- 
stant is used to avoid calculating the logarithm of ze- 
ro. 

[0020] The mathematical operation performed by the 
logarithm transform module 26 Is an example of single 
valued function transform, i.e. each input value has a 
single corresponding output value. This operation may 
be implemented as a succession of mathematical oper- 
ations (add, log, multiple, add) In computer hardware or 
software. However, for large color digital images the 
same operation is more computationally efficient imple- 
mented as a LUT transformation. For the purposes of 
the present invention, the LUT Implementation and the 
succession of mathematical operations implementation 
will be referred to as logarithmic transforms. 

Details of the Preferred Embodiment of the Noise 
Reduction module 100 

[0021] The noise reduction module 100 depicted in 
Figure 4 is shown in more detail in Figure 5. The noise 
reduction module 1 00 performs the tasks of calculating 
a color weighting mask and using the color weighting 
mask in conjunction with a noise reduction filter to mod- 
ify a source color digital image to produce a noise re- 



[0023] The analysis phase of the noise reduction 
module 100 depicted in Figures employs a luminance- 
chrominance module 110 to produce a luminance/ 

25 chrominance, or LCC color digital image, version of the 
input color digital image consisting of a luminance digital 
image channel and two chrominance digital image 
channels denoted by GM and IL. The luminance- 
chrominance module 110 employs a 3x3 matrix trans- 

30 formation to convert the red. green, and blue pixel val- 
ues into luminance and chrominance pixel values. Let 
Rjj, Gy t and By refer to the pixel values corresponding to 
the red, green, and blue digital image channels located 
at the i th row and j th column. Let Ly, GMy, and ILy refer 

35 to the transformed luminance, first chrominance, and 
second chrominance pixel values respectively of the 
output LCC color digital image. The 3x3 matrix transfor- 
mation relating the input and output pixel values is as 
follows: 

40 

Ljj = 0.333 Ry + 0.333 G fj + 0.333 By (4) 
^ GMy = -0.25 Ry + 0.50 G tJ - 0.25 By 

ILjj = -0.50 Ry + 0.50 By 

5° Those skilled in the art will recognize that the exact num- 
bers used for coefficients in the luminance/chrominance 
matrix transformation may be altered and still yield sub- 
stantially the same effect. An alternative embodiment of 
the present invention uses the following mathematical 
55 formulation: 
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Ljj = 0.375 R y + 0.50 G y + 0.125 By {5} 
GMn = -0.25 R„ + 0.50 G„ - 0.25 B„ 



IL g = -0.50 Ry+ 0.60 By 

Details of the Color Weighting Factor Generator 120 

[0024] A color weighting mask is a two dimensional 
array of numerical weighting factors. The numerical 
weighting factors of a color weighting mask relate to the 
relative importance of pixel location. Color weighting 
masks are used by the present invention in conjunction 
with a digital image channel to adjust or regulate the 
spatial processing of the pixels values of a color digital 
image. 

[0025] Referring to Figures, thecolorweighting factor 
generator 120 receives the chrominance digital Image 
channels from the luminance-chrominance module 110 
and a set of predetermined color region poles. Each 
color region pole includes a GM and IL value. These two 
values form a2-dimensianal coordinate focation in color 
space. LetGM k and IL k denote the values of the k lh color 
region pole and let N denote the number of color region 
poles in the set. Each color region pole represents a 
unique color in 2-dimensional color space for which the 
noise reduction processing of the source colordigital im- 
age will be preferentially treated. 
[0026] Referring to Figure 6, three regions differenti- 
ated for noise reduction processing are identified as a 
blue sky region 122, a green grass region 124 and a 
skin region 1 26. At the center of each of these color re- 
gions is the location of the of a corresponding color re- 
gion pole. The actual numerical value of the GM and IL 
components of the color region poles depends on the 
color and/or logarithmic transformation used, For a giv- 
en digital imaging application, once the color and/or log- 
arithmic transformation experimentation with typical im- 
agery is used to determine the numerical value of the 
color region pole GM and IL values. 
[0027] Each color region pole can designate either 
emphasized or de-emphasized noise reduction 
processing of the pixels values of a color digital image 
depending the preference of the digital image process- 
ing application design goals. For the preferred embodi- 
ment of the present invention, design goal of reducing 
noise in colordigital images includes a color region pole 
for the blue sky region of color space emphasizes more 
noise reduction while the color region potefor the green 
grass region of color space de-emphasizes noise reduc- 
tion (less effective noise reduction). Consequently, color 
digital images processed with this configuration of the 
present invention will result in more noise removed from 
image blue sky regions than for image green grass re- 



gions. 

[0028] The emp has is o r de-emphasis of noise reduc- 
tion processing is accomplished by calculating a color 
weighting factor for each pixel processed. The color 
s weighting factor Is a single numerical value which en- 
compasses the sum total of emphasis and de-emphasis 
effects from all the color region poles in the set of color 
region poles. For each color region pole a two chromi- 
nance distance values, represented by x and y, are cal- 
culated as the distance from the location in color space 
of the fp pixel to the k m color region pole for each color 
space dimension. Let represent the distance be- 
tween the k^ color region pole GM value and the GM 
value of the ij th pixel as 

y, jk = GM r GM k (6) 

and Xy k representee distance between the k th color re- 
gion pole IL value and the IL value of the ij^ pixel as 

X IJk =IL r IL k (7) 

The range of color distance influence of the k th color re- 
gion pole is determined by two corresponding pole pa- 
rameters a xk and o yk . As these pole parameters are set 
to larger numerical values the influence of the k th color 
region pole will be greater. The color pole weighting fac- 
tor c|> k corresponding to the k th color region pole and ij th 
pixel is given by 

*flk = a ok + «k e ( 8 ) 

where a k is a color pole emphasis factor which deter- 
mines the relative strength of the k^ 1 color region pole 
and a ok is a numerical constant that determines the val- 
ue of the k th color regio n pole for at large color distances. 
Positive color pole emphasis factors indicate more noise 
reduction processing emphasis white negative color 
pole emphasis factors indicate less noise reduction 
processing emphasis or a de-emphasis. 
[0029] Additional ly : the Gaussian q u antion can b e ro- 
tated in color space to providemore flexibility in defining 
a color region. Let 6 k rep resent the rotation angle in color 
space for the color region pole and let x'^ and y'^ 
represent the rotated coordinates and given by the 
equation 

x'j jk = x^ cos(q) - y ijk sin(q) (9) 



55 

y' ijk = x ijk sln(q) + y jjk cos(q) 
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The color pole weighting factor <j> k corresponding to the 
k th color region pole and Ip pixel is obtained by using 
equation (8) with the variables x'jj k and y'|j k . 
[0030] The values of the color pole emphasis factor 
o^. can be adjusted for more or less effect depending on 
the digital imaging application. The preferred embodi- 
ment of the present invention uses a value of 1 .0 for a 0 
and 0.25 for o^. sky and flesh color regions and -0.25 for 
the green grass color region. The values foro\ k andc yk 
are set to values identified uniquely for the flesh color, 
green grass color, and blue sky color regions. The 
present invention can be practiced with many different 
choices of chrominance value descriptions. However, to 
achieve optimum results, the values of the a xk for and 
o~ yk variables should be adjusted if a equation than as 
given by (5) is usedto generatethe chrominance values, 
[0031] The color weighting factor for the ij th pixel oOfj is 
given by the sum of all the individual color pole welghtl ng 
factors <|> k as 

0),, = <|> 0 + E k c|> k (10) 

where <\> Q is a numerical constant which determines the 
default value of the color weighting factors. Thus the 
color weighting factors calculated for all the pixels of 
the source color digital image constitute a color weight- 
ing mask . 

[0032] An alternative embodiment of the present in- 
vention calculates the color weighting factors o>ij by mul- 
tiplicatively combining the Individual color pole weight- 
ing factors (|> k as 

0)y = $ 0 + n k ^ (11) 

[0033] An alternative embodiment of the present in- 
vention bases the coordinate pair GM and IL values on 
a spatially filtered version of the pixels of the source 
color digital image. A spatial smoothing filter designed 
to reduce the amplitude of high spatial frequency mod- 
ulations is used to filter the source color digital image. 
A 2-dimensional Gaussian filter is used as the spatial 
smoothing filter The filtered version color digital image 
is processed with the luminance chrominance module 
110 to produce the color space coordinates as used by 
the preferred embodiment of the present invention. This 
alternative embodiment of the present invention re- 
quires more computational resources due the additional 
processing step of spatially filtering. However, for vary 
noisy color digital images the benefit of this embodiment 
is a more gradual regulation of the noise reduction 
achieved. 

[0034] Another alternative embodiment of the present 
invention calculates the color weighting factors Ojj for 
each pixel in the source color digital image and assem- 
bles the values into a color weighting mask . This color 



weighting mask is then filtered with a spatial smoothing 
filter designed to reduce the amplitude of high spatial 
frequency modulations. The resulting spatially filtered 
coior weighting mask is then used in similar fashion as 
5 described above. 

[0035] Those skilled in the art will recognize that the 
present invention is not limited to three color regions but 
may be practiced with any number of color regions. De- 
pending on the digital imaging application, any color re- 
10 gion which can be found through experimentation as re- 
quiring a different level of noise reduction can be target- 
ed as a chrominnace pole coordinate pair. 
[0036] The chrominance pixel values of the two 
chrominance digital image channels are examples of 
color difference values derived from the pixels of the 
source color digital image. Although the present inven- 
tion uses a 2-dimensional cDlorspace representation for 
simplicity and computational efficiency, those skilled in 
the art will recognize that the present invention can be 
practiced with color weighting factors cafculated from 
otherforms of color difference values calculated in other 
coior space representations, but not limited to, CiELAB 
(a*,b* or C*,H*), CIELUV, and generalized RGB. 

Details of the Noise Filter Module 130 

[0037] Referring to Figure 5, the noise filter module 
1 30 receives the source color digital image and th e color 
weighting mask from the color weighting factor genera- 
tor 120 and uses the color weighting mask to adjust the 
noise reduction processing. 

[0038] The Sigma filter, described by Jong-Sen Lee 
in the journal article Digital Image Smoothing and the 
Sigma Filter, Computer Vision, Graphics, and image 
Processing Vol 24, p. 255-269, 1983, is a noise reduc- 
tion algorithm designed to enhance the visual appear- 
ance of color digital images. The values of the pixels 
contained in a local neighborhood of pixels, n by n pixels 
where n denotes the length of pixels In either the row or 
column direction, are compared with the value of the 
center pixel, or pixel of interest. Each pixel in the s local 
neighborhood of pixels is given a weighting factor of one 
or zero based on the absolute difference between the 
value of the pixel of interest and the local neighborhood 
pixel value. If the absolute value of the pixel value dif- 
ference is less or equal to a threshold s, the weighting 
factor if set to one. Otherwise, theweightingfactorisset 
to zero. The numerical constants is set to two times the 
expected noise standard deviation. Mathematically the 
expression forthe calculation of the noise reduced pixel 
value is given as 

^ff = 2 mn a mn Pmn ' £ mn a mn ( 12 ) 

and 
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a mn= 1 ' f, Pmn-Pijl<=£ 

a mn = 0 if lp mn -p,j! > e 

where p mn represents the mri lh pixel contained in the 
local neighborhood of pixels, py represents the value of 
the pixel of interest located at row i and column j, a mn 
represents a weighting factor, q,j represents the noise 
reduced pixel value, and e represents a threshofd vari- 
able of the noise reduction process. The preferred em- 
bodiment of the present invention does not use all of the 
pixels in a rectangular local neighborhood of pixels. The 
radial pattern of pixels used within a 6 by 5 pixel rectan- 
gular local neighborhood of pixels is shown in Figure 7. 
The pixel of interest py is marked with an X (item 202) 
while the pixels of the local neighborhood of pixels are 
marked with an A (items 203). 
[0039] The noise form many sources of color digital 
images is signal dependent. The signal dependent 
noise and the chrominance dependent features of the 
present invention are incorporated into the expression 
for e given by 

£=SfeCCDy CT^Pij) (13) 

where a n represents the noise standard deviation of the 
sou rce [mage eval uated at the center p Ixel value py. The 
parameter Sfac can be used to vary the degree of noise 
reduction. Both the Sfacaud e variables are examples 
of a noise adjustment parameter The calculation of the 
noise reduced pixel value q,j as the division of the two 
sums is then calculated. The process is completed for 
some or all of the pixels contained in the digital image 
channel and for some or all the digital image channels 
contained in the color digital image. The noise reduced 
pixel values constitute the noise reduced color digital 
image. 

[0040] The present invention may be used to vary the 
[evel of noise reduction achieved by varying the size of 
the local neighborhood of pixels based on the color 
weighting factors oay. Figure 8 shows a 5 by 5 pixel local 
neighborhood of pixels used to achieve more noise re- 
duction while Figure 9 shows a 3 by 3 pixel local neigh- 
borhood of pixels used to achieve less noise reduction. 
The same color weighting factors as described above 
are used to determine the size of the local neighborhood 
of pixels. The range of coji values is divided into different 
segments relating to the different sizes of local neigh- 
borhood of pixels. For example, pixels of interest with 
corresponding color weighting factors with values in the 
lowest one third of the range of of values use a 3 by 
3 pixel local neighborhood of pixels, the middle third of 
o)jj values use a 5 by 5 pixel focal neighborhood of pixels 
and the highest one third of the range of of ay values 



use a 7 by 7 pixel local neighborhood of pixels. 
[0041] The sigma filter as described by Lee is one ex- 
ample of a pixel difference filter that can be used in the 
present invention. The central aspect of a pixel differ- 
5 ence filter is a spatial filter that calculates a noise free 
pixel estimate based on the pixel values in a local neigh- 
borhood of pixels about a pixel of interest, wherein the 
influence of each local pixel is based on the difference 
between the local pixel value and a reference numerical 
10 value derived from the pixels in the local neighborhood. 
The preferred embodiment of a pixel difference filter 
used in the present invention uses the pixel of interest 
as the reference numerical value. Other values such as 
the average of pixels in the local neighborhood can also 
is , be used as the reference numerical value. 

[0042] Another example of a pixel difference filter is 
the Inverse Gradient Filter described by D. C. C. Wang 
et al. In their published paper Gradient Inverse Weighted 
Smoothing Scheme and the Evaluation of its Perform- 
ance , Computer Graphics and Image Processing Vol 
15. p. 167-181, 1981. This algorithm produced a noise 
cleaned Image by taking a non-linear weighting of the 
local pixel values from a rectangular sampling region 
about the center pixel. The weighting factor was based 
on the magnitude difference between the center pixel 
and the surrounding pixel value. 
[0043] Another alternative embodiment of the present 
invention uses a median filter as the basic noise reduc- 
tion logic to form the noise reduced pixel value. As 
above, the color weighting factors coq are used to vary 
the size of the local neighborhood of pixels. 
[0044] The preferred and alternative embodiment of 
the present invention both use the color information of 
pixels in the source color digital image to calculate a 
weighting factor which Is used to vary the level of noise 
reduction achieved. It has been shown that the level of 
noise reduction can be varied by regulating the size of 
the local neighborhood of pixels used or by varying a 
regulation variable directly. Since the color Information 
based weighting factor (the color weighting factory) is 
based on a near continuous function (a function that can 
assume three or more values) of the pixel of interest 
color coordinates, the resultant noise reduction 
achieved is also continuous or near continuous. Thus 
color digital images processed with the present inven- 
tion do not exhibit sharp or discontinuous variations in 
noise reduction. 



Claims 

1. A digital image processing method for enhancing a 
color digital image having pixel values, comprising 
the steps of: 

a) Identifying a pixel of Interest in the color dig- 
ital image; 

b) identifying a local neighborhood of pixels 
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about the pixel of interest; 

c) using the values of pixel sampled from the 
local neighborhood to calculate a color weight- 
ing factor for the pixel of interest, the color 
weighting factor being a near continuous func- 
tion; 

d) using the color weighting factor and the val- 
ues of pixels sampled from the local neighbor- 
hood to calculate a noise reduced pixel value; 

e) repiacing the value of the pixe[ of interest 
with the noise reduced pixel value; and 

f) repeating steps (a) through (e) for other pixels 
in the color digital image. 



10. The method claimed in claim 9, wherein the statis- 
tical quantity is a mean, median, minimum, or max- 
imum. 



10 



2. The method claimed in claim 1 , wherein step c) fur- 
ther comprises the steps of 
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3. 



(I) identifying one or more color regions In color 
space; 

(ii) calculating a pixel color coordinate in color 
space for the pixel of interest; 
(111) calculating a color weighting factor as a 
near continuous function of the pixel color co- 
ordinate and the color regions. 

The method claimed In claim 1 , wherein step d) fur- 
ther comprises the step of calculating differences of 
pixel values sampled from the local neighborhood 
and using the differences of pixels values and the 
color weighting factor to calculate a noise reduced 
pixel value. 
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The method claimed in claim 3, wherein step d) fur- 
ther comprises the step of comparing the differenc- 
es of pixel values with a threshold parameter and 
using the color weighting factor to vary the value of 
the threshold parameter. 
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The method claimed in claim 4, wherein step d) fur- 
ther comprises the step of varying the threshold pa- 
rameter as a function of an expected noise level, 
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6. The method claimed in claim 5, wherein the expect- 
ed noise level is also a function of the pixel values 
of the local neighborhood. 
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7. The method claimed in claim 1 , wherein step (d) fur- 
ther comprises the step of using the color weighting 
factor to vary the size of the local neighborhood. 

8. The method claimed in claim 2, wherein step (d) fur- 
ther comprises the step of using the color weighting 
factor to vary the size of the local neighborhood. 



so 



The method claimed in claim 7, wherein the noise 
reduced pixel value Is derived from a statistical 
quantity of the pixel values sampled from a local 
neighborhood. 
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